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Foreword 



This report presents an analysis and evaluation of some of the aspects 
of the goal setting processes that were followed by California school dis- 
tricts in developing conununity -based goals, subgoals and priorities. Data 
for the evaluation project were obtained solely from questionnaires distributed 
to school districts throughoyt the State. The actual goal setting models 
which were used by local districts, for which the authors of this report 
have no direct knowledge and for which no information was sought or provided, 
were not studied. For a more comprehensive evaluation, it would be 
necessary to study all aspects of the goal setting processes and models in 
detail to more completely determine their strengths and weaki. ^sses. Such 
an evaluation design would include other evaluation techniques and sources 
of data other than or in addition to a questionnaire. One such evaluation 
study--an in-depth study of the goal setting processes in select districts-- 
was underway at the time this report was written. 

The findings and conclusions presented in this report are substantiated 
by the available evidence. However, because of the limited scope of the 
present evaluation project, its results are subject to that limitation. 
Within the limits of available information, recommendations have been made 
for future action. Hopefully, those recoramendationjs ? if implemented, will 
result in positive action which will further the cause of providing a 
quality and equality educational system for California'" youth. 



Vern Weber 

Systems Planning Corporation 
January 1975 
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Section 1 



1 Introduction 



1 . 1 Purpose of the Evaluation 

The purpose of evaluating'processes used by California school districts 
to develop goals, subgoals and priorities was to provide a clearer under- 
standing of those processes and to enable recommendations to be made for 
improving any future goal setting effort. To achieve this purpose, the 
following questions were raised and investigated: 

- What goal setting models were used by local school districts in 

the development of their goals, subgoals and priorities? (Section 2.1) 

- What was the usage and value of the goal setting steps recommended in 
Education for the People , Volume I? What alternative goal setting 
steps c^ere used? (Section 2.2) 

- Wha- were the strengths and weaknesses of the goal setting steps 
and other parts of the processes? What can be done to overcome the 
weaknesses? Where should more or less emphasis be given? (Sections 
2,2, 2.3 and 2.4) 

- What assistance was given to school communities during the develop- 
ment of goals? What additional assistance would have been useful? 
(Section 2.5) 

- What follow-up projects or activities were initia* d or completed 
as a result of the adoption of goals? (Section 

1 . 2 Data Gathering Techniques 

To answer the questions raised in Section 1.1, a questionnaire (see 
following page) was designed and distributed to the State's school districts. 
Those questionnaires were then completed and/or verified by a five-member 
district reporting committee consisting of a community representative, a 
board member, an administrator, a teacher and a student. Members of the 
committee generally included persons who had been involved in the original 
goal setting process and who therefore had direct knowledge of that process. 
Personnel from county schools offices served only in an indirect way by 
answering questions and by verifying that the questionnaires were completed. 
A total of 813 out of the 831 districts that participated in the goals collec- 
tion project returned completed questionnaires — therefore, about 98% of the 
participating school districts complied with all requests for data; 

The questions included in the questionnaire were designed in compliance 
with the requirements of the Invitation for Bid and the "Data Collection and 
Reporting Format" memorandum dated July 5, 1973 which was adopted by the 
Joint Committee on Educational Goals and Evaluation and included a&ra part 
of the IFB. Some of the questions were included to permit a determination 
to be made as to whether a school district met the goals collecti ^n criteria 
specified in the Joint Committee's July 5, 1973 memorandum. No additional 
data were requested from school districts, but any additional information 
provided was considered in the preparation of this report. 
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COUNTY 



GOAL SETTING PROCESS INFORMATION FORM 
SCHOOL DISTRICT 



1. What goal setting model was used in your district? "Education for the People," Volume 1 Model □ NorCal Model □ Fresno Model □ 
Locally Developed Model □ NoneQ Other Model (speclfy)Q _. 

2. Were the "Education for the People" documents used as a resource In planning and developing the goal setting process for your district? Yes □ 

No n 

3. * For each of the goal setting steps listed below, indicate the extent to which your district used each step in the goal setting process and the value 

or degree of usefulness of each step. (A blank would Indicate that a step was not used or was of no value; an answer of I would indicate little use 
or little value; and 5 would Indicate high use or high value.) If steps In addition to or other than those listed were used in the goa< setting process, 
add those steps to the end of the list and Indicate their appropriate sequence In the process (e.g.. Be.). 



1) The governing board and superintendent 
jointly proposed the goal and priority 
setting process. 

2) The governing board authorized the goal 
and priority setting process and committed 
resources tc Initiate the planning phase. 

3) The governing board and superintendent 
broadly publicized the scope of the pro- 
cess. 

4) The governing board requested open nom- 
inations of persons to serve on a district- 
wide steering committee. 

5) The governing board appointed a repre- 
sentative district steering committee from 
the list of non>inees. 

6} Workshops were held for district steering 
committee members to explain the task 
and familiarize them with resources avail- 
able to them. 

7) The district steering committee designed 
a goal setting process for the district. 

8) The governing board adopted a ^oat setting 
process plan and committed the necessary 
resources. 

9) School steering committees were selected 
for each school=community, including, 
the school principal. 



10) Workshops were held for school steering 
committee members to explain the task 
and familiarize them with resources avail- 
able to them. 

11) Each school steering committee selected 
resource materials and persons to assist 
during the goal setting process. 

12) Invitations and appeals went out to all 
members of the school=communlty to 
participate in the goal setting process. 

13) Students, V-iochers, parents, administrators, 
other school employees, and all other inter- 
ested persons met to initiate the goal setting 
process. 

14) Participants selected representatives to 
serve on a new districtwide goals committee. 

15) Statements from each school=community 
were forward ' to the 'Jistrlct goals com- 
mittee for inclusion In drafts of district 
philosophy, goals, goal indicators, program 
objectives* and priorities. 

16) The goal setting process continued with re- 
views and revisions and more refined drafts. 

17) Each school'Commur^ity submitted its 
final draft to the district goals committee. 



Extent Used Value 
12345 12345 
□□□□□ □□□□□ 



□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ 

□□□□□ □□□□□ 

nnnnn □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 

□□□□□ □□□□□ 



18) The district goals committee submitted 
Its final draft to the governing board for 
review and adoption. 

19) The governing board held public hearings 
on the proposed draft and developed 

an official draft. 

20) The governing board adopted district 
philosophy, goals, goal indicators, prograrr 
objectives, and priorities. 



Extent Used 
1 2 3 4 5 
□□□□□ 



Value 
1 2 3 4 5 
□□□□□ 



□□□□□ □□□□□ • 



□□□□□ □□□□□ 



) Other (specify) 



) Other (specify) 



) Other (specify) . 



) Other (specify) . 



) Other (specify) 



) Other (specify) 



) Other (specify) . 



□□□□□ □□□□□ 



□□□□□ □□□□□ 



□□□□□ □□□□□ 



□□□□□ □□□□□ 



□□□□□ □□□□□ 



□□□□□ □□□□□ 



□□□□□ □□□□□ 



EKLC 
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**K?°^U' 5"t)-?oals, and priorities used in the Goals Collection Project adopted or re^adopted by the district governing board after July 1. 1970? 
•MO Q Date of adoption 

Pa?t°c"lPa°lonT°"^ Indicate the extent to which they participated In the goal setting process. (Leave blank If not applicable or If there 







Little 


Moderate 


High 


1) 


Community members 






n 


2) 


District administrators 


□ 


□ 


□ 


3) 


Classified district Personnel 


□ 


□ 


□ 


4) 


Classroom teachers 


□ 


□ 


□ 


5) 


High school students 


□ 


□ 


□ 


6) 


Elementary students 


□ 


□ 


□ 



6* Were Persons from all ethnic groups In the district Involved in the goal setting process? Yes □ No □ Were Persons from all economic groups 
(various Income levels) m the district Involved In ttie goal setting process? YesQ No □ Were Persons from all geographical areas of the 
district involved In the goal setting process? YesQ NoQ. i— 

7. * Was the goal setting process operated at each school site, with district level I'oals derived from the combined school goals? Yes □ No □ If no. 

n»*»!n®K^°^i^ process operated centrally or at regional sites, with partlcipajtlon from each school site and with school=communltles free to 
establish and pursue their own goals and prcgram priorities within a district framework? Yes □ No □ 

8. What estimated percentage of the adult district population participated In the goal setting process? % 

9. Was the 9oal setting Process worthwhile In meeting school=communlty needs? Yes □ No □ Do you Intend to recycle the goal setting process? 
Yes U NoD If yes. how frequently? 1 year □ 2 yearsQ 3 years □ 4 yearsD 5 or more years □ 

10. Indicate for each type of assistance below the extent to which you received such assistance for your district In the goal setting process and the 
source (s) of such assistance. 

Low High d - if > 

12345 iLinuQa 

1) Inservice Training □□□□□ □□□□□ 

2) Outside Consultants □□□□□ □□□□□ 

3) Financial Assistance □□□□□ □□□□□ 

4) Other (specify) □□□□□ □□□□□ 

11. Indicate for each type of assistance below the extent to which such assistance would have provided additional help for your district in the goal 
setting process, and the best source (s) for such assistance. 

Low High ^ ^.i 

12345 iLiuiuOa: 

1) Inservice Training □□□□□ □□□□□ 

2) Outside Consultants □□□□□ □□□□□ 

3) Financial Assistance □□□□□ □□□□□ 

4) Other (specify) □□□□□ □□□□□ 

12. Identify any followup projects or activities that have been initiated or completed as a result of the adoption of goals, sub-goals, and priorities. 



1) 


District and Schools Philosophy 


Initiated 
□ 


Comi 
□ 


2) 


Program Objectives 


□ 


□ 


3) 


Goal Indicator:. 


□ 


□ 


4) 


Revised 5chool Programs 


□ 


□ 


5) 


School or District Advisory Council 


□ 


□ 


6) 


Decentralized Budgeting 


□ 


□ 


7) 


Othftf (sDficIfy) 


□ 


□ 



DISTRICT REPORTING COMMITTEE VERIFICATION* 

The District Reporting Committee, by a majority vote, hereby approves the coding designations as presented In this report. 



COMMUNITY REPRESENTATIVE GOVERNING BOARD MEMBER 



DISTRICT ADMINISTRATOR TEACHER 



ERIC 



STUDENT 

COUNTY SUPERINTENDENT or DESIGNEE 9 DATE 

* Pertains to criteria described In July 5. 1973 memorandum, '^Background for Data Collection and Reporting Format. 



1.3 Limitations of the Data 



Several questions in the questionnaire were presented without objec- 
tive standards being included to guide district reporting committees in 
their responses. The lack of such standards may have influenced the 
consistency of those responses. For example, question 5 concerning 
participation by various groups requested a none-little-moderate-high 
response, but no guidelines for determining what constituted a certain 
degree of participation were given. Widely circulating needs assessment 
instruments, making extensive appeals to the public, conducting door to 
door surveys, requesting direct personal involvement of community mem- 
bers? etc,> could all have been interpreted to mean different levels of 
involvement in different districts. 

Where possible, districts attempted to have the questionnaires com- 
pleted by persons who were directly knowledgeable about the goal setting 
processes that were followed. However, since the questionnaires were 
generally completed several years after the goals were developed, subjec- 
tive responses to questions may have been influenced by a misunderstanding 
of the available facts or by the varying degree of knowledge of the pro- 
cesses by individual committee members. 

An "other" category was included with certain questions to obtain 
additional information for the evaluation. All additional items or 
activities reported by participating districts, even if mentioned only 
once, were included in this evaluation report. If specific additional 
categories had been included in the questionnaire, more responses to those 
categories, and therefore more useful data, may have been obtained. The 
additional items therefore indicate only the types of other activities 
that occurred--no inferences should be made concerning their importance 
or the extent to which they occurred as a result of their frequency of 
mention. 

For most of the questions in the questionnaire only positive responses 
were used for the analysis or for determining whether a particular goals 
collection criterion was met. In tabulating responses to the questions, 
however, unanswered questions were interpreted to mean a "no" answer or 
"no" participation. For this reason, questions which were inadvertently 
left blank by the school district may imply a more negative response 
than may have been the actual case. The number of blank responses was 
believed to be small; they were therefore ignored in the analysis. In any 
event, distortions in the data by blank responses or coding errors of 
any type would probably be insignificant in comparison with the variations 
in the responses to subjective questions. 
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Section 2 

Presentation and Analysis of Data 



2 Presentation and Analysis of Data 



Tabulations and analyses of the responses to the twelve questions 
which comprised the "Goal Setting Process Information Form" and related 
goal setting process information are presented in this section. The numbers 
of the questions whose data were used in each section below is included in 
the section headings. A computer output report of the responses by dis- 
trict organization type for the participating school districts is also 
presented in the Appendix. 



2.1 Goal Setting Models (Questionnaire Questions 1,2,4) 

Goal setting models used by school districts throughout the State of 
California to develop goals, subgOcils and priorities were, by frequency 
mentioned: 



Locally Developed Models 424 (5l7p) 

Nor Cal Model 179 (22%) 

Fresnv. Model 131 (16%) 

Education for the People 44 ( 5%) 

Delphi Method 11 ( 1%) 

Placer System 10 ( 1%) 

PPBS 8 ( 1%) 

Other Models 24 ( 3%) 

In the above totals, school districts that specified "none" or who left 
the question unanswered were counted as having locally developed models^ 
Models identified as "Chico State" or "Pace Center" were considered to be 
t'ae same as "Nor Cal", and such responses were therefore aggregated « No 
other aggregations were made although several of the models are believed 
to differ in name only. 



Frotii the above table it is obvious that the majority of school dis- 
tricts developed their own procedures for the goal setting process^ However, 
such independent development was reportedly not done in isolation. Many 
school districts reported that their models were developed from several 
existing models and publications. Frequent references were made to the 
usage of parts of the models that were developed by county schools offices- 
or neighboring school districts^ While many districts reported that Educa-^ 
tion for the People , Volumes I & II were received too late to be useful in 
their goal settin;> processes, 361 districts reported chat those documents 
were used as a resource in planning and developing their processes. This 
implies that over three-fourths of the 424 school di;:;tricts that developed 
their own goal setting model used the Education for the People documents to 
some degree o 

In addition to the wide variety of goal setting models that were 
developed and used, numerous techniques were reported which augmented 
the goal development process. Such techniques included card sorts, com- 
puterized tabulation of input, community survey questionnaires, synchonical 
approaches and modified delphi techniques. 
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Adoption dates of goals as reported by school districts supports the 
evidence that many school districts were too far into their goal setting 
processes to effectively utilize many resource documents that were published. 
The adoption (or readoption) dates of 585 districts reporting such infor- 
mation were as follows: 

1968 1969 1970 1971 1972 1973 ' 1974 

1 3 12 47 222 168 132 

The year 1972 was further broken down by quarter as: 1st 36; 2nd 78; 
3rd 43; and 4th 47, Therefore, about a third of the school districts 
already had goals, subgoals and priorities developed and adopted by the 
suTiiruer of 1972, and many other districts had their processes well under way. 
Since the Education for the People documents were not distributed until the 
summer of 1972, they were received too late to have a significant impact in 
many districts. The degree to which these documents will be used in future 
goal recycling efforts is unknown. 

Because of the frequent mention by school districts of the review of 
models and publications developed by others, it is concluded that most 
serious efforts to provide initial leadership to the goal development problem 
was given careful consideration by California educators. It is surmised that 
the complexity of the task and the difficulty in understanding subtle con- 
cepts by educators and lay persons alike contributed to this search for 
leadership. 
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2.2 Goal Setting Step^s (Questionnaire Question 3) 



Presented in the illustration below is a plot of the number of school 
districts that reported using the goal setting steps which were described 
in Education for the People . Data from all districts were tabulated, regard- 
less of the goal setting model which was followed. The average number of 
districts using each step was 582 — ten steps fall above that average and 
ten steps fall below it. Since some districts that reported data apparently 
chose to leave question 3 of the questionnaire blank, the steps should be 
compared relative to each other rather than being considered as an absolute 
measure of use by all participating districts. 



800 



NUMBER OF DISTRICTS USING 
EDUCATION FOR THE PEOPLE 
GOAL SETTING STEPS 
813 DISTRICTS REPORTING 



•800 



600 



400 



200 



■600 



-400 



■200 



7 8 9 10 11 12 13 14 15 16 17 18 19 20 



The four most frequently used steps, in descending order, were: 
Step Description 

2 The governing board authorized the goal and priority setting 
process and committed resources to initiate the planning phase, 

3 The governing board and superintendent broadly publicized the 
scope of the process. 
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Step 



Description 



18 The district goals committee submitted its final draft to the 

governing board for review and adoption, 

20 The governing board adopted district philosophy, goals, goal 

indicators, progri^:. objectives, and priorities. 

Since these, or similar steps must be executed by all districts, regardless 
of the goal setting process followed, the outcome is consistent with expec- 
tations. 

The four least frequently used steps, in ascending order were: 
Step Description 

14 Participants selected representatives to serve on a new district- 
wide goals committee. 

17 Each school=community submitted its final draft to the district 

goals committee. 

11 Each school steering committee selected resource materials and 

persons to assist during the goal setting process. 

15 Statements from each school=community were forwarded to the dis- 
trict goals committee for inclusion in drafts of district philosophy, 
goals, goal indicators, program objectives, and priorities, 

Ther are several factors which apparently accounted for the lack of 
usage of these steps. The most prominent factor is the large number of 
small school districts in the state that have only one or a few schools, 
(Almost half of the State's school dis tricts--over 500— have only one or 
a few schools where the attendance areas are the entire district.) These 
steps simply do not apply to such districts since the district steering 
committee and the school steering committee are one and the same. Further, 
from the lack of. usage of step 14, it appears that many districts did not 
feel a need to replace the initially assembled steering committee. It may 
also be inferred from the limited usage of steps 17 and 15 that many of the 
goal setting models followed did not obtain input from the school-community 
level before building districtwide goals. (This is consistent with the 
response to question 7 of the questionnaire, which states that only about 
half of the districts developed goals at each school site.) The limited 
usage of step 11 may also be partly due to the lack of availability of 
resource materials and consultants. This is supported by the responses 
to questions 10 and 11, where it was reported that additional financing, 
resource materials and consultants would have been useful throughout the 
goal setting process. 

To obtain a better understanding of the degree of usage of the goal 
setting steps, the following illustration, which plots the weighted responses 
of those districts actually using each step, is presented. A value of 1 is 
low and a value of 5 is high. 

15 
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DEGREE OF USAGE 
EDUCATION FOR THE PEOPLE 
GOAL SETTING STEPS 



- 5 



J 11 12 13 14 15 16 17 18 19 20 



From the illustration it can be seen that, in general, those districts 
that reported using a goal setting step used it to a high degree. Caution 
is advised, however, in making direct inferences from the graph, since some 
of the 20 steps related more to an event than an activity. An event, such 
as step 18, which is subject more to a yes/no answer than to a degree, would 
probably have a value of 5 checked more frequently than a more process 
oriented activity. Steps 11 and 14, which had the lowest degree of usage 
reported, indicate that only limited resource materials were selected and 
that a partial selection of new representatives was made. 

The value of each goal setting step was calculated in a fashion similar 
to the degree of usage. The weighted value responses for each step were 
divided by the number of districts reporting a usage of that step. The 
results are presented in the illustration on the following page. 

There is a high correlation between the value graph and the degree of 
usage graph. This indicates that most school districts considered the 
value of a goal setting step to be a direct function of the degree to which 
they usad that step; i.e., the more a step was used, the more value it was 
believed to have. It is not known whether the perceived value was the cause 
of selecting a step to follow or whether the value determined was the effect 
of following a step. 



16 



I— •>::•:» 



-9- 



5 



VALUE OF 
EDUCATION FOR THE PEOPLE 
GOAL SETTING STEPS 



10 11 12 13 14 15 16 17 18 19 20 



In addition to the usage and value responses to the 20 step goal 
setting process, numerous alternative procedures were reported by the 
participating school districts. Various methods of implementing a goal 
setting process were often widely divergent. In some cases, the divergence 
could be traced to the variations in school district size. For example, 
small school districts, by the very nature of their smallness, were often 
able to make personal contact with all community members. Large school 
districts, often hampered by a lack of time, personnel and other resources, 
often resorted to more impersonal contacts such as mailed surveys, news- 
letters or newspaper advertisements. In other cases, there was some 
evidence that different procedures were the result of different levels of 
understanding or different perspectives of governing boards, administrators, 
teachers and community members. 

Not all the goal setting steps were used by all goal setting models. 
For example, goal setting steps which relate to steering committees at the 
district or school level were usually not followed by the Nor Cal Model o 
For small school districts where the district and school level committees 
were one and the same, steps 4, 5, 9, 14, 15 and 17 may have been unnecessary. 
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Rather than simply producing a list of some of the alternative pro- 
cedures that were follov/ed, each of the 20 Education for the People goal 
setting steps is presented below together with a discussion of some of 
the variations that were reported and some of the given or inferred reasons 
behind the alternatives. 

1. The governing board and superintendent jointly proposed the goal 
and priority setting process . 

2. The governing board authorized the goal and priority setting process 
and committed resources to initiate the planning phase > 

These two steps were usually undertaken jointly by the governing board 
and superintendent, but it was occasionally reported that the superin- 
tendent independently proposed and authorized the goal setting process. 
It was also reported that administrative staffs and district faculty 
councils played major roles in the initial phases. Outside organizations, 
such as ACSA or CSBA, were sometimes consulted prior to initiating the 
goal setting process. 

3. The governing board and superintendent broadly publicized the scope 
of the process . 

The intent to develop goals was reportedly publicized both districtwide 
and in each school-community through various modes of communication « 
Publicizing methods included newspaper releases, school newsletters, 
special letters to community members, conducting a general community 
conference and personal contacts « Some districts reported that letters 
and advertisements were prepared in English and Spanish. The governing 
board often appointed one of its members to work with the superintendent 
to carry out following steps. 

4. The governing board requested open nominations of persons to serve 
on a districtwide steering committee . 

Numerous variations to this approach were reported ranging from no 
committee at all to a committee consisting of everyone who volunteered 
(sometimes reportedly consisting of over a hundred persons). In lieu 
of creating a new conraiittee, some districts designated existing groups 
as the steering committee. Such existing groups included the governing 
board itself, administrative staffs, educator committees, curricjlam 
advisory committees and parent advisory groups. In most cases, .vever, 
the steering committee reportedly consisted of several comra;'.r!t> members, 
district personnel and, occasionally, a board member. 

The method used to select community representatives ranged from direct 
appointment to a random selection from all district residents. Nomi- 
nations, when made, came from district administrators j school principals, 
teacher groups, community groups, etc. 
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As a major alternative to the initial formation of a districtwide 
steering committee, some districts reported that such a committee 
was not formed until after school or regional steering committees 
were formed. In such cases, the districtwide committee was then 
comprised of representatives of each school or regional committee. 

When districtwide steering committees were not formed at all, the 
goal setting results were usually forwarded directly to the admini- 
stration and/or board froiu the schc ,1 or regional levels. Small school 
districts often involved the entire district Vithout the formation of 
a central committee. 

5. The governing board appointed a representa tive district steering 
committee from the list of nominees . 

As stated under step 4, committee members, if a committee was formed 
at all, were not always appointed. Nor were they always representative 
of the various district components such as teachers, staff, community 
cross-section, etc. It was also reported that in some districts 
committee members were appointed directly by the superintendent, his 
assistant, the district coordinating councils or local school curriculum 
advisory councils instead of being appointed ty the board. As a varia- 
tion, the board sometimes appointed a nucleus and other groups appointed 
the remaining representatives. 

6. Workshops were held for district steering committee members to 
explain the task and familiarize them with resourc es ava ilable to them . 

Apparently, workshops of some type or. another were usually held for 
the various group leaders and goal setting participants. Often, these 
workshops were conducted by county schools pearsonnel who were knpwledg- 
able in goal setting processes. This was particularly true in districts 
that had formulated plans to 'use county developed models for their goal 
setting process. 

7. The district steering committee designed a _goal setting process for 
the district . 

Alternatively, the goal setting process was developed by district staff, 
by a sub-committee of teachers, administrators and community members or 
by instructional planning councils. An already existing model was also 
often selected. In such cases, the district steeritig committee merely 
approved" the process or made minor changes only. 

8. The governing board adopted a goal setting_process plan and committed 
the necessary resources . 

Adoption of the goal setting process was also reported to have been an 
action of the superintendent or his cabinet. In some cases, the board 
merely reviewed and approved the process and did not adopt it. Also, 
in some districts the board selected several processes and permitted 
each school-community to. make its own selection as desired. 
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9. School steering committees were selected for each school^community , 
including the school principal. 



When the school district consisted of only one or a few schools, this 
step vas usually bypassed since the district and school steering 
committees were one and the same. Selection procedures similar to 
those outlined under step 4 were used, except that school steering 
committees usually consisted only of school level administrators, 
staff and community members. Nucleus school steering committee 
members were sometimes selected by staff. For some districts, all 
goal development participants became members of f-he commit tee« 

10, Workshops were held for school steering comnilt : tee members to explain 
the task and familiarize them with resources availa&lc^ to them . 

These workshops were often held in conjunction with workshops for the 
districtwide steering committee. County and disl<±ct personnel who 
were to assist throughout the goal scLLing process v;ere often brought 
in as facilitators or to be trained in their loler-i xn the particular 
district. In place of a workshop, the goal settltig process was explained 
to participants at a community meeting, personally, and/or by letter. 
Resource materials were usually provided by the district, 

11, Each school steering conmiittee selected resource materials and 
persons to assist during the goal setting process . 

It would be more accurate to say that resource materials and persons 
were provided rather than selected. Such resources were reportedly 
limited for the tasks to be conducted, 

12, Invitations and appeals went out to all members of the school= 
community to participate in the goal setting process . 

Numerous methods were used to accomplish this task. In many districts, 
particularly large ones, questionnaires seeking goals input were mailed 
rather than personal attendance at meetings being requested. Such 
questionnaires were either mailed to all addresses or to randomly 
selected addresses, and were also sent to certificated and classified 
employees and to randomly selected students. It was reported that 
English and Spanish questionnaires were available in schools and in 
ESL classes. 

In smaller school districts, questionnaires were still often used, 
but personal contacts s such as door-to-door surveys, sometimes replaced 
mass mailings. Apparently, a smaller district had a higher likelihood 
of having personal participation by community members in the goal 
setting process. It was also reported that paid interviewers were 
sometimes used to solicit information from parents and other community 
members , 
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13, Students, teachers, parents, administrators, other school employees , 
and all other interested persons met to initiate the goal setting process . 

This goal setting step had both the highest number of alternatives 
reported and the greatest divergence of alternatives. 

In general, the goal setting process was initiated earlier by meetings 
of the districtwide or school committees with other groups being 
phased in at a later date. This was particularly true in districts 
where the school steering committee was also the goal setting committee. 
Some districts reported that students and community members did not 
participate at all in initial meetings, 

A major alternative to the combined personnel approach was to have each 
group — students , teachers , parents and adminis trators — meet separately 
to draft independently developed tentative goals. The results of these 
separate meetings and/or the groups themselves were then brought together 
for the purpose of building common goals. 

Another major alternative approach followed by some districts was to 
formulate sub-groups for the purpose of developing goals within topical 
areas. Topical workshops were then scheduled; all interested persons 
were invited to attend any or all workshops. These sub-groups submitted 
their tentative goals to a general committee for development of the 
final goals draft. When the topical approach to goal setting was 
followed, leaders of each topical group were usually appointed^ijy a 
districtwide steering committee to obtain input from each school- 
community. Topical goals were therefore usually developed districtwide 
rather than at each school site. 

Another major alternative approach to goal setting was a "top-down" 
approach rather than a "bottom-up" approach. Under the "top-down" 
approach, tentative goals were developed at the district level and 
were then forwarded to the school-communities for evaluation, revision 
and ranking. In some district;? it was reported that the initial draft 
was prepared by teachers and/or administrators. 

Regardless of the goal setting approach followed, a series of meetings 
were usually held to complete the process. Such meetings were sometimes 
held at local school sites and sometimes at regional or central locations 
encompassing several school -communities or the entire district. Some 
districts also reported holding separate goal setting meetings for non- 
English speaking participants. Weekend goal setting retreats were also 
reported in a few cases. 

14, Participants selected representatives to serve on a new district- 
wide goals committee . 

Members of a new districtwide goals committee, when formed, were fre- 
quently the chairpersons of the school goals committees. In some 
districts each school parent association had representation through 
the coordinating council, 
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15. Statements from each school=conimunity were forwarded to the dis- 
trict goals committee for inclusion in drafts of district philosophy, goals , 
goal indicators, program objectives, and priorities . 

Initial efforts were usually limited to developing statements of 
philosophy and goals. In many cases, priorities were not determined 
until after the goals had been adopted. 

School level data were usually refined for consistent language before 
being included in the district level data. In large districts, 
regional goals committees may have been set up between the school and 
district levels. 

As a major alternative, school level data were sometimes submitted to 
the district office for review and final preparation of district goals, 
or such data may have been submitted directly to the board for review 
and adoption. 

16. The goal setting process continued with reviews and revisions and 
more refined drafts . 

After the initial draft was submitted to the higher level committee, 
some districts reported that goals compiled at the higher level were 
returned to the school -community or to the community at large for 
review and comment. 

17. Each school=community submitted its final draft to the district 
goals committee . 

As previously stated, the final draft may have been developed by 
reviewing and synthesizing school -community goals, topical goals or 
goals developed independently by various groups. Also, the final 
sub-district level drafts may have been submitted to a regional 
committee, to a districtwide committee, to the district office or 
directly to the governing board, depending upon the particular approach 
selected. 

Public meetings were reportedly held to get community reaction to the 
final draft. 

18. The district goals committee submitted its final draft to the 
governing board for review and adoption . 

Preliminary drafts were also reported to have been forwarded to the 
board for early review and comment. 

One district reported that the board and administration held a retreat 
to discuss and evaluate the final draft. 



22 



-15- 



19. The governing board held public hearings on the proposed draft 



and developed an official draft. 



Publication of the proposed draft in the local press was also used 
to solicit public response. Modifications to the wording of goals 
were made in some cases as a result of community input or by board 
action. 

Some districts conducted statistical studies to determine the degree 
of agreement on goals by various groups. Comparison studies of goals, 
priorities and perceived success levels were also reportedly made at 
separate school sites and districtwide, 

20. The governing board adopted district philosophy, goals, goal 
indicators, program objectives, and priorities . 

In the initial goal setting efforts, usually only statements of 
philosophy, goals and priorities were developed and adopted. Priority 
setting was sometimes withheld until after the goals were adopted. 

In some districts, school level goals or goals developed by independent 
groups were adopted as the district goals without being synthesized 
into a common set. 



The goal setting process steps described in Education for the Peo ple 
stopped with the adoption of goals and priorities. However, many districts 
roDOrted that the process was a continuous one, and that activities directly 
relating to the adopted goals and priorities were immediately initiated. 
Presented below are some of those activities that were reported by partici- 
pating school districts as extensions of the goal setting process in response 
to question 3 of the questionnaire. The number of times that each activity 
was mentioned is given in peren theses. 

• Adopted goals were widely disseminated throughout the community. (10) 

• Follow-up meetings were held to re-evaluate the goals and set 
priorities. (8) 

• The goal setting process was evaluated. (2) 

• The board directed goal indicators and program objectives relating 
to the prioritized goals to be developed to the classroom level. (18) 

• The board adopted district policy to implement community goal 
priorities. (2) 

• Procedures and baseline data were established to monitor progress 

and to enable achievement of programs and goals to be determined. (12) 

• Evaluation plans to determine student status and progress in priority 
areas were developed. (14) 

• Goals became a part of the evaluation process for certificated 
personnel. (2) 23 

-16- 



2.3 Participation in Goal Setting Process (Questionnaire Questions 5,6,7,8) 
» 

Presented in the illustration below is the degree of participation 
in the goal setting process by community members and various school dis- 
trict groups. High, moderate, little, and no participation levels are 
shown for each group. To extract all useful information,^ it is necessary 
to compare the various groups within a particular level of participation 
and also to review the various participation levels for a particular group. 



GOAL SETTING PARTICIPATION 
ALL ELEM, SEC & UNIFIED SCHOOL DISTRICTS 
NUMBER OF DISTRICTS 



HIGH 



COMMUNITY 
ADKLN. 
CLASSIFIED 
TEACHERS 
H.S. ST. 
ELEM. ST. 



MODERATE 



COMMUNITY 
ADMIN. 
CLASSIFIED 
TEACHERS 
H.S. ST. 
ELEM. ST. 



LITTLE 



NONE 



COMMUNITY 
ADMIN. 
CLASSIFIED 
TEACHERS 
H.S. ST. 
ELEM. ST. 



COMMUNITY 
ADMIN. 
CLASSIFIED 
TEACHERS 
H.S. ST. 
ELEM. ST. 



From the above illustration, it can be seen that community members, 
administrators and classroom teachers all tended to participate moderately 
to high. Clcissified personnel participated to a somewhat lower degree 
overall — from little to moderate, with approximately equal numbers of 
districts reporting no participation and high participation. Elementary 
and high school students had the lowest overall degree of participation, 
with an extreme skewing to the low side being evident. The different 
degrees of participation for each school -community group can be more 
clearly seen in the illustration below. 

24 



(;_.ST!i-| 



-17- 



GOAL SETTING PARTICIPATION 
ALL ELEM, SEC & UNIFIED SCHOOL DISTRICTS 
NUMBER OF DISTRICTS 



COMMUNITY 



LECHERS 



HIGH 
MODERATE 
LITTLE 
NONE 



HIGH 
MODERATE 
LITTLE 
NONE 



ADMIN. 



H.S. STUDENTS 



HIGH 
MODERATE 
LITTLE 
NONE 



HIGH 
MODERATE 
LITTLE 
NONE 



CLASSIFIED 



ELEM. STUDENTS 



HIGH 
MODERATE 
LITTLE 
NONE 



HIGH 
MODERATE 
LITTLE 
NONE 



Since the above illustrations combine data for all school districts, 
they do not tell the whole story of student participation. The illustra- 
tion below presents elementary, secondary and unified school -community 
group participation by percentage (to allow the various districts types 
to be compared) . From the illustration it can be seen that for elementary 
school districts alone, elementary student participation was higher. About 
one third of the elementary districts reported moderate tohigh partici- 
pation, about one-third reported little participation and about one-third 
no participation. In secondary and unified school districts, less than 
one-tenth reported no participation by high school students. 
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GOAL SETTING PARTICIPATION 
BY PERCENTAGE 
TOP LINE = ELEMENTARY DISTRICTS 
>aDDLE LINE = SECONDARY DISTRICTS 
BOTTCM LINE = UNIFIED DISTRICTS 



HIGH 

COMMUNITY . 

ADMIN. ^^^= 

CLASSIFIED S^rp: 
TEACHERS 

H.S. ST. 

ELEM. ST. £Zr~ 



LITTLE 

COMMUNITY =: 

ADMIN. ==- 

CLASSIFIED ^^^= 

TEACHERS =: 

H.S. ST. ^==- 

ELEM. ST. 



Most school districts reported a high degree of community participation 
by ethnic and economic groups and by persons from all parts of the district. 
Over four-fifths of the districts reported that all three groups participated 
in the goal setting process. 

Almost nine-tenths of the school districts reported that the goal setting 
processes were conducted at each school site with district level goals derived 
from combined school goals or regionally with participation from each school 
site. The majority of processes were conducted at each school site rather 
than regionally. 
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MODERATE 

COMMUNITY ^^^^ 

ADMIN. 

CLASSIFIED ^^^^= 

TEACHERS ^^^= 
H.S. ST. 

ELEM. ST. 



NONE 

COMMUNITY =: 

ADMIN. 

CLASSIFIED = 

TEACHERS =" 

H.S. ST. ^=r 

ELEM. ST. ^= 



In response to the question concerning the percentage of adult partici- 
pation, over half of the districts reported that less than ten percent of 
the district adults participated in the goal setting process. Less than 
one-fifth of the districts reported an adult population participation of 
25 percent or more. No attempt was made to correlate adult population 
participation percentages to community member low-middle-high degrees of 
participation since a common criterion was not provided with the question- 
naires. However, since over half of the districts reported a high degree 
of participation by community members and an adult participation of less 
than ten percent, it appears that degrees of participation, which were 
subjectively perceived, bear no direct relationship to adult participation 
percentages. It is possible that the opportunity to respond to questionnaires 
or to direct appeals was considered to constitute a high level of partici- 
pation while it would not necessarily be considered to increase the adult 
participation percentage. 

In a memorandum dated July 5, 1973 by the Joint Committee on Educational 
Goals and Evaluation, data collection criteria were specified to determine 
which data set the goals, subgoals and priorities of a school district 
would be entered into. Each criterion and the number of school districts (out 
of 831 districts reporting goals data) that met each criterion is summarized 
in the following table. In addition to the criteria listed in the table, 
which relate directly to school district data, several other criteria which 
relate to the format for reporting, the data collection agency, procedures 
for collection, etc. were included. Those other criteria were met through 
the design and execution of the goals collection project. 

Of the 831 participating school districts, only 217 school districts 
met all criteria. The most limiting criterion, as seen in the table, was 
the level of involvement of classified district personnel, with only 53% 
meeting that criterion. The second most limiting criterion was elementary 
student participation, with 79% overall. The degree to which each criterion 
was met was generally similar for elementary, secondary and unified dis- 
tricts. However, the required level of participation by high school students 
in high school and unified districts was met by 75% of the districts* and 
the required level of participation by elementary students in elementary 
districts was met by 67% of those districts. 

Since over 700 of the 831 participating school districts met most of 
the criteria, a change in the definition of what constituted compliance 
with the criteria would have resulted in a higher number of school districts 
falling into the conforming data set. 



GOALS COLLECTION CRITERIA 
NUMBER AND PERCENTAGE OF DISTRICTS MEETING 



Elementary Secondary Unified 
(533 Dists.) (92 Dists.) (206 Dists.) 



Total 
(831 Dists.) 



1. Verification by a five- 
member district 
reporting committee 
(three signatures 
required) . 

2. Goals, subgoals and 
priorities adopted or 
re-adopted after July 1 
1970. 

3. Community members 
involved at least 
moderately. 




766 
(92%) 



686 
(83%) 



730 
(88%) 



4. District administrators 
involved at least 
moderately. 

5. Classified district 
personnel involved at 
least moderately. 

6. Classroom teachers 
involved at least 
moderately. 



460 
(86%) 



287 
(54%) 



476 
(89%) 



80 

(87%) 



47 

(51%) 



85 

(92%) 



179 
(87%) 



105 
(51%) 



188 
(91%) 



719 
(87%) 



439 
(53%) 



749 
(90%) 



7. High school students 
involved at least 
moderately. 

8. Elementary students 
involved at least a 
little. 

9. All ethnic groups 
involved. 




757 
(91%) 



653 
(79%) 



706 
(85%) 



10. All economic groups 
involved. 

11. Persons from all geo- 
graphic areas involved. 

12. Goal setting operated 
at each school site or 



465 
(87%) 

482 
(90%) 

479 
(90%) 



78 

(85%) 
82 

(89%) 

87 

(95%) 



180 
(87%) 

189 
(92%) 

179 
(87%) 



723 
(87%) 

753 
(91%) 

745 
(90%) 
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2p4 Reaction to Goal Setting Process (Questionnaire Question 9) 



About nine-tenths of the school districts submitting goal setting 
process data responded that they believed that the goal setting process 
was worthwhile ia meeting school-community needs. They also reported 
that they planned to recycle the goal setting process in the future. The 
most frequently mentioned recycle period, as shown in the graph below, 
was three years, A large number of districts also reported that they 
planned to recycle their goal setting process every five years or more. 



RECYCLE FREQUENCY 



1 2 3 4 5 

YEARS 



Many districts submitted evidence which suggested that a large number 
of follow-up activities were necessary before a recycling effort could 
occur (see Sections 2.2 and 2.6). After the adoption of goals and priorities, 
goal indicators and program objectives have to be completed, an evaluation 
system has to be designed, and programs have to initiated, completed, 
evaluated and reviewed before subsequent revisions to the entire process 
could effectively occur. Apparently, most districts felt that this process 
required at least three years to complete. 



2.5 Goal Setting Process Assistance (Questionnaire Questions 10,11) 



Presented in the illustration below are data reported by school dis- 
tricts regarding the degree and source of assistance which they actually 
received as they conducted their goal setting processes. 



INSERVICE TRAINING ASSISTANCE RECEIVED 
DEGREE SOURCE 

1 LOW — FEDERAL • 

2 — STATE — 

3 MOD ■ COUNTY — 



4 — - DISTRICT 

5 HIGH — ^— PRIVATE 



OUTSIDE CONSULTANTS ASSISTANCE RECEIVED 
DEGREE SOURCE 

1 LOW » FEDERAL 

2 STATE "i- 

3 MOD — ^ COUNTY 

4 — DISTRICT — ^ 

5 HIGH PRIVATE 

FINANCIAL ASSISTANCE RECEIVED 
DEGREE SOURCE 

1 LOW — — FEDERAL • 

2 — STATE ■ 

3 MOD ■ COUNTY — 

4 tm DISTRICT ^^^^ 

5 HIGH PRIVATE 



The greatest assistance to school districts was provided in the form 
of inservice training by county schools offices. The school districts 
themselves in turn provided a high degree of inservice training to the 
participants in the goal setting process. To a somewhat lesser degree 
than inservice training, school districts received assistance from county 
schools offices in the form of direct consulting. Such consulting may 
have taken the form of assisting in the community based goal setting 
process as well as holding training seminars for district personnel. 
Financial assistance was generally reported to be low and, where provided, 
was mainly provided by each school district for its own goal setting 
process. Federal, state and private resources provided to local school 
districts in the form of personnel or money were generally minimal. 

In addition to the above three categories of assistance, many school 
districts reported receiving additional assistance. Additional assistance 
received, and the frequency with which each category was mentioned, 
include: 



Resource materials and publications (14) 
ACSA Project Leadership (5) 
CSBA (5) 

Other school districts (5) 
Community support (9) 
Computer time (3) 
Other district support (6) 

The most commonly mentioned sources of publications were the state and 
county, although reference was made to goals and publications obtained 
from other districts, ACSA, CSBA, universities and ' the work of previous 
committees. Resource materials were mostly provided by the district or 
the county. Community support was provided in numerous forms, including 
community donations (cash and services), PTA, service club involvement, 
newspaper articles and advertisements, etc.. Other district support pro- 
vided included such miscellaneous items as release time for teachers, 
administrators' time, staff awareness seminars and school visitations. 

Presented in the illustration below are data regarding the degree 
and source of assistance which school districts felt would have provided 
additional help as they developed their goals, subgoals and priorities. 



ADDITIONAL INSERVICE TRAINING ASSISTANCE DESIRED 



DEGREE SOURCE 

1 LOW — FEDERAL - 

2 STATE 

3 MOD COUNTY 

4 — DISTRICT "^-^ 

5 HI GH PRIVATE — 



ADDITIONAL OUTSIDE CONSULTANTS ASSISTANCE DESIRED 
DEGREE SOURCE 

1 LOW — FEDERAL 

2 - STATE ■ 

3 MOD • COUNTY ■ 

4 — DISTRICT 

5 HI GH PRIVATE 



ADDITIONAL FINANCIAL ASSISTANCE DESIRED 

DEGREE SOURCE 

1 LOW — ■ FEDERAL — • 

2 - STATE — — 

3 MOD —» COUNTY — 

4 » DISTRICT — • 

5 HIGH — PRIVATE 



While the assistance that was actually received revealed a definite 
emphasis on assistance at the county and district levels, additional 
assistance that was desired has the emphasis placed upon state and county 
levels. The desire for additional training and consultants was somewhat 



less than that which was generally received, indicating that for the most 
part districts were satisfied with the level of involvement of outside 
personnel. Additional inservice training and outside consultants that 
were desired were mostly desired from the county level, although a distinct 
request for higher levels of participation from the state can be detected 
from the illustration. 

The illustration clearly shows a desire for additional financial 
support. Since more districts reported a desire for a higher degree of 
financing than they actually received, it may be inferred that districts 
generally felt that the actual level of financing was too low. Further, 
while the school districts themselves were the primary sources of the 
actual funding, there was a general concensus that additional funding 
should come from the state. It is surmised that this desire is the result 
of a state directed goal setting effort. 

Other types of desired assistance were reported by various school dis- 
tricts. Such additional assistance, and the frequency with which they 
were mentioned can basically be classified as follows: 

Resource materials and samples (5) 
Other district support (16) 

Other district support desired included such activities as systematic 
follow-up and providing for the development and implementation of programs 
to meet goals, reviewing budget procedures for funding programs, providing 
bilingual/intercultural moderators, providing personnel to assist in logis- 
tics, contacting participants, obtaining former student input, conducting 
out-of-district workshops, providing more time from the teaching day and 
obtaining more community involvement. 



2.6 Follc3w-'Up Projects or Activities (Questionnaire Question 12) 



Six types of follow-up projects or activities that are generally 
carried our in school districts were included in the questionnaire. The 
numbers of school districts who reported that they initiated or completed 
those projects or activities were as follows: 





Initiated 


Completed 


Total 


District and Schools philosophy 


134 


494 


628 


Program Objectives 


348 


331 


679 


Goal Indicators 


225 


259 


484 


Revised School Programs 


413 


212 


625 


School or District Advisory Council 


214 


248 


462 


Decentralized Budgeting 


170 


99 


269 



From this table, it can be seen that the type of activity most likely to 
have been completed as a result of the goal setting process was the deve^ 
ment of statements of philosophy. There has also been considerable progr s 
made in the development of program objectives and goal indicators. While i 
large number of districts have initiated projects which are directed towa d 
revising school programs, only about a third of such projects have been com- 
pleted. It is assumed that the size of any effort to revise educational 
programs and to redirect resources is primarily responsible for delays in 
the completion of such an effort. 

In addition to the above six types of activities, school districts 
reported many other activities of a related nature that were either initiated 
or completed since the goals of the district were adopted. These additional 
activities are presented below under the categories of goals and objectives, 
educational programs and teaching practices, and testing and evaluation. 
Districts frequently mentioned that the follow-on activities were on-going 
processes which were therefore being continuously revised. 

Goals and Objectives (20) 

Goal interpretation (5) 

Program/performance objectives related to goals (3) 
Decentralized/classroom objectives (2) 
Needs assessment (7) 
Prioritizing (3) 

Educational Programs and Teaching Practices (35) 

Educational Master Plan (2) 

Curriculum review (2) 

Graduation studies/requirements (4) 

Curriculum council /congress (3) 

PPBS Level V/VI (1) 

Teacher advisor groups (2) 

O A 
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Educational Programs and Teaching Practices (continued) 

New school programs (7) 

Special State and Federal projects (8) 

Expanded vocational education (2) 

Individualizing instruction (1) 

Instructional aides (1) 

Redirection of funds and services (2) 

Testing and Evaluation (7) 

Locally developed criterion referenced testing (1) 
Program evaluation and revision (2) 

Objectives of school personnel in the evaluation process (1) 
Certificated evaluation system (2) 
Evaluation of goal fulfillment (1) 



Several new educational programs that were reported as being impl 
mented as a result of the adoption of goals include early childhood 
education, bilingual education. Title I programs, and EDY, 



Section 3 
Results 



3 Results 



3. 1 Summary and Conclusions 

From all evidence available, it is concluded that goals, subgoals and 
priorities and subsequent programs for action were developed in the over- 
whelming majority of California school districts and were further considered 
by those districts to be positive steps in improving school -community 
communication and relationships and in being responsive to local needs and 
desires. It is also concluded that Education for the People documents, as 
well as other serious efforts by educational leaders and organizations, were 
responsible for providing the type of leadership and guidance that enabled 
the successful completion of the goal setting process. 

Much of the credit for the successful accomplishment of the goal setting 
effort should be shared by the California Legislature and its committees who 
formulated plans and developed resource materials for the California school 
districts; the State Department of Education who worked cooperatively with 
legislative committees, county schools offices and school districts; the 
County Superintendents of Schools and their staffs who provided much of the 
front-line duty in bringing the process to fruitation; and the school dis- 
tricts themselves who committed time, personnel and other resources to 
accomplish the task. But most importantly, the real credit should go to 
the efforts of the "People" from whom emanated the kind of clear thinking 
that enabled much of the theoretical debate to be set aside while the future 
of their children was being discussed. 

Presented below are summary responses to the five questions which were 
raised in Section 1.1. 

Question 1 : What goal setting models were used by local school dis- 
tricts in the development of their goals, subgoals and priorities? 

Locally developed models were used in over half (51%) of the school 
districts. Nor Cal (227o) and Fresno (16%) models accounted for the 
bulk of the remaining districts. The Education for the People model 
was directly used by only five percent of the districts; however, 
over three-fourths of the districts that developed their own models 
reported using Education for the People as resource documents « 

There are two primary reasons why many school districts did not directly 
adopt Education for the People as their goal setting model: 1) the 
documents were received too late (summer of 1972) in many districts 
to serve as the model as goal setting processes were already complete 
or underway; and 2) many school districts did not perceive the documents 
to be a model at all, but rather viewed them only as resources for 
developing their own model. Part of the reason for not viewing Educa- 
tion for the People as a model was the flexible nature of the goal 
setting steps outlined and the lack of specific directions for carrying 
out each step. When districts augmented their model with their own 
time frame for execution, personnel to be involved, materials to be 
used, techniques to be implemented, etc., they felt their model to be 
more properly designated as "locally developed". 
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Question 2 ; What was the usage and value of the goal setting steps 
recommended in Education for the People , Volume I ? What alternative goal 
setting steps were used? 

All goal setting steps recommended in Education for the People were 
used to a high degree and were reported to have high value by those 
districts using them. Those steps therefore satisfactorily described 
the actual goal setting processes of most districts. Steps which 
referenced direct board and superintendent actions, conducting work- 
shops and actually carrying out the goal setting process, which tended 
to be used regardless of the model, were used to the highest degree. 
Those steps which referenced districtwide and schcol steering committees 
and school -community goal setting activities were used to the lowest 
degree. The primary reasons for the low usage of these steps was the 
high usage of the Nor Cal Model and the large number of small school 
districts. The Nor Cal Model did not require the formation of steering 
committees. In small school districts, districtwide and school level 
activities were one and the same, 

A number of alternative goal setting steps were used, most of which 
were minor variations of the Education for the People steps. The 
most major variations concerned the creation of committees (size, 
composition and selection methods) , the methods for contacting and 
involving community members, and the approaches to developing goals. 
Five major goal development approaches were followed: 1) school or 
regional goals were developed by a mixture of representatives of all 
groups and then synthesized into district goals; 2) district goals 
were directly developed by a mixture of representatives of all groups; 
3) district goals were developed by each group and then synthesized 
into common district goals; 4) district goals in topical areas were 
developed by a mixture of representatives of all groups and then 
combined to form a complete goal set; 5) district goals were developed 
by district teachers/administrators and then sent to school-communities 
for review and revision. 

Question 3 : What were the strengths and weaknesses of the goal setting 
steps and other parts of the processes? What can be done to overcome the 
weaknesses? Where should more or less emphasis be given? 

A principal strength of the Education for the People goal setting 
steps was the flexibility in enabling local school districts to 
systematically develop processes to meet the unique needs of their 
communities. Another strength was the evident concern shown for 
the need for a high degree of participation from everyone to provide 
direction for major educational decision making, (A moderate to 
high degree of participation by community members, teachers, admini- 
strators and high school students was reported. Classified personnel 
participated from little to moderate. About two-thirds of elementary 
students participated at least a little,) 
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From the high usage of the steps and the high value placed upon the 
steps that were used, it is concluded that the goal setting process 
was considered to be a significant project by California school dis- 
trictSo From the stated beliefs of the majority of school districts 
that the goal setting process was worthwhile in meeting local needs 
and that they plan to recycle the process in the future, it is con- 
cluded that the process as well as the outcome was useful to local 
school districts for educational decision making. 

One of the weaknesses of the goal setting steps and process was that 
it was not directly applicable to small school districts. Since over 
half of the state's school districts have under 1,000 A.D.A. , it would 
be beneficial if special publications and guidelines would be developed 
to help them meet their special needs. If single statewide publications 
are developed for all districts, then sections that are sensitive to 
the needs of different sizes and types of communities would be desirable. 
This could be accomplished by defining a minimum process or minimum 
requirements and then expanding upon them to allow for special situations 
or needs. 

The need to form an initial districtwide steering committee and then 
later replace it with a new committee was considered by many districts 
to be unnecessary. It would perhaps have been logistically and 
politically better to form school -community committees first and then 
have the districtwide committee formed from their representatives. 

Another weakness of the processes concerned the lack of available 
financing, resource materials and personnel. Greater community parti- 
cipation can come about through increased distribution of materials 
and more personal contacts being made. Distributed materials could 
also help the public to better understand their schools, regardless 
of whether or not they become directly involved in a goal setting 
process. 

If broad representation is desired of all community groups identified 
by various socio-economic and demographic characteristics, all school 
district personnel groupSa- and students from all grade groups, then 
additional procedures to direct districts in determing those character- 
istics, identifying the groups and making the selections would be 
useful. Definitions of degrees of participation should also be made. 
Since in many cases an individual may belong to more than one group, 
procedures should also be developed to resolve this classification 
problem. For example, while district classified personnel involvement 
was reportedly low, many of the classified personnel may have partici- 
pated in the process as community members. 

Question 4 ; What assistance was given to school communities during 
the development of goals? What additional assistance would have been 
useful? 
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Most outside assistance to school communities during the development 
of goals came from county schools offices. This assistance was 
reportedly high. For this reason, much of the credit for the success- 
ful completion of the goal setting processes statewide should be 
shared by the county school superintendents and their staffs. 

Almost all financing committed to conduct the goal setting process 

was the responsibility of each local school district, and was generally 

reported as being low to moderate. A request was therefore made for 

additional financial assistance from the state. Districts also requested 

moderate additional personnel assistance from both the county and state 

levels. 



Question 5 ; What follow-up projects or activities were initiated or 
completed as a result of the adoption of goals? 

The most commonly completed related activity as a result of the goal 
setting process was the development of statements of philosophy — over 
three-fourths of all districts initiating such an activity have com- 
pleted it. Most districts have also made considerable headway in the 
development of program objectives and goal indicators — about half of 
such projects have been completed. A large effort has also been 
reported in revising school programs; however, only about a third of 
siich projects have been carried to completion. Numerous other inno- 
vative activities were also reported to be underway in various dis- 
tricts as an extension of the goal setting process. Those activities 
are classified under the general headings of goals and objectives, 
educational programs and teaching practices, and testing and evaluation. 
Upon completion of the evaluation, one full cycle of the entire process 
can be considered to be completed. Most districts reported that this 
full cycle requires about three years to complete. 

As of the fall of 1974, decentralized budgets have been developed in 
about ten percent of the state's school districts and initiated in 
about twenty percent more. Time delays in completing budget construc- 
tion changes, even when planned, can be due to other personnel commit- 
ments (such as revising programs which districts may wish to complete 
first) , the opportunity to conveniently decentralize once a year at 
budget time, and the need to plan for major accounting changes. 

From the evidence gathered, it appears that the actual effort to 
revise goals, subgoals and priorities requires only minimal effort 
on the part of community committees, teacher groups and administrators 
once evaluation and effectiveness studies have been completed. It is 
suggested, however, that major review of the goals by the entire 
community be made periodically to ensure continued responsiveness to 
community needs. Such a review could be done in conjunction with the 
development or redevelopment of an educational master plan. 



40 



3.2 Recommendations 



The following general recommendations for improving future goal setting 
processes or for recycling of the processes were based upon evidence pre- 
sented in this report, inferences drawn from that evidence, and professional 
insight gained throughout the goals collection project. More specific 
suggestions for improvement were made throughout the report. 

As further knowledge about the theories underlying various goal setting 
models and methods becomes available, and evidence can be obtained to test 
those theories and their underlying assumptions, new recommendations should 
be formulated accordingly. 

Recommendation 1 ; Guidelines to assist school districts in completing 
one complete cycle of the goal setting process — from the initial setting 
of goals, subgoals and priorities to the determination of the extent to 
which those goals are being met — should be prepared and disseminated. Such 
guidelines should place emphasis upon describing the kind of follow-up 
projects and activities that could be of benefit in implementing adopted 
goals determining if goals are achievable and, if so, what resources are 
necessary to achieve them. Also to be included should be procedures for 
recycling the goal setting process, reviewing and revising goals, and 
re-adopting updated goals, subgoals and priorities. (Note: The preparation 
of Education for the People , Volume III may respond to part of this need for 
additional guidelines.) 

Recommendation 2 ; Provide state level leadership to local school dis- 
tricts on a district request basis in the form of inservice training and 
resource materials to assist districts in carrying out activities initiated 
as a result of or subsequent to the development of goals and in recycling 
goal setting efforts as desired. 

Recommendation 3 ; Conduct further research projects into each major 
goal setting model to determine model characteristics which led to the 
development of goals that were most useful for educational planning and 
effectively meeting community and student needs. Such a research project 
should address presently unanswered questions such as the following: 

1) To what degree does each model use an inductive and/or deductive approach?; 

2) What model approaches were best suited to obtaining real and perceived 
student and community needs?; 3) Do different iriW^s produce goals, sub- 
goals and priorities that are significantly diffeTfent from each other?; 

4) What model approaches produced results that could be readily interpreted 
into programs for action?; 5) What model approaches resulted in increased 
educational effectiveness?; etc. 

Recommendation 4 : Conduct further research projects into the goal 
setting processes of school districts to determine those processes which 
were most effective in meeting the stated goals and objectives of the 
process. Such a research project should address presently unanswered 
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questions such as the following: 1) Do different levels of participation 
of various community and school groups result in significantly different 
levels of effectiveness in meeting community needs?; 2) What is the degree 
of validity of assumptions which were made preceding any goal setting 
effort? ; 3) What are the strengths and weaknesses of the five major goal 
development approaches which were described in Section 3,1, Question 2?; 
4) How do various social, economic, demographic and philosophical charac- 
teristics of school districts relate to the t3rpes of goal setting processes 
used or to similarities and differences in the outcome?; etc, (Note: The 
in-depth goal setting process evaluation study which was underway at the 
time this report was written may respond to some of the above questions,) 



42 

-34- 



Bibliography 



ERIC 



Bibliography 



Joint Committee on Educational Goals and Evaluation. Education for the 
People . Volumes I and II. Sacramento: State of California, 1972. 

Joint Committee on Educational Goals and Evaluation. Background for Data 

Collection and Reporting Format . Memorandum. Sacramento: California 
Legislature, July 5, 1973. 

Joint Committee on Educational Goals and Evaluation and Department of 
Education. Goals Category Catalog Preliminary Draft . Sacramento: 
State of California, January 7, 1974. 

Department of Education/Office of Program Planning and Development. 

Collection, Categorization and Reporting of Educational Goals, Sub« 
Goals and Priorities and Goal Setting Process Evaluation (IFB DOE 
74«-01) . Sacramento: State of California, March 26, 1974. 

Joint Committee on Educational Goals and Evaluation and Department of 
Education. Statement of Position Regarding State Collection of 
Educational Goals and Priorities From Local Educational Agencies . 
Memorandum. Sacramento: California Legislature, June 6, 1974. 

Systems Planning Corporation. Goals Collection Project Data Collection 

Procedures Manual . Sacramento: State of California, September 1974. 

Systems Planning Corporation. Goals Collection Project Data Processing 
System ^ Sacramento: State of California, October 1974. 

Systems Planning Corporation. Compilation of Fall 1974 Goals, Subgoals 

and Priorities Meeting Goals Collection Criteria . Sacramento : S t at e 
of California, January 1975. 

Systems Planning Corporation. Compilation of Fall 1974 Goals, Subgoals 
and Priorities Not Meeting Goals Collection Criteria . Sacramento: 
State of California, January 1975. 

Systems Planning Corporation. Compilation of Fall 1974 Goals, Subgoals 
and Priorities — Detailed Presentation of Data . Sacramento: State 
of California, January 1975. 

Systems Planning Corporation. Goals Collection Project Goal Setting Process 
Evaluation Report . Sacramento: State of California, January 1975. 

Systems Planning Corporation. Goals Collection Project Evaluation Report . 
Sacramento: State of California, February 1975. 



44 



ERIC 



-35- 



73-281 (03-1288) 84971 300 6-75 7M 



Appendix 



45 

o 

ERIC 



UJ 

o 



CO 
00 



o 
u. 



< 
o 



1 »— 

o 
a. 
jj 

o 

^ 

^ >^ 

o a: 

H- to -I 
< •-I -I 
^ o ^ 

re Ul 
O -I 
O 

2 O 

r 

o 
to y) 
to 

UJ ^ 

O CO 

O T 

o 



o 



vO 
O 



• <t ro ^ ^ 

o <r ^ oj 
z ^ ^ 



• sO (\J -4 O 



< 

5 
o 

uJ 
7> 

CVJ 
Ox 



• ro ru X n 

z 



UJ 



CO 
CO 



O ro M t) lO 
Z -< fVI 



o 



3 



UJ 

-I 



o 



JJ 
r 



o 

UJ 



UJ 

o 



o o o ru 



CVJ o ^ 



^ o oj ^ 



ro rg ^ ro 



^ ^ ^ (\j 



o o o ^ 



'jO 



ERIC 



c/) 



< 
o 



CC »1 c 

o o z 

Ij^ CO 

or. uj 
3 o a 
UJ z 



O — ' 
jJ X 
< X 

Ul ^ UJ 

o < o 



o o ^ o 



^ ^- ro 



Id 

< 



< 

O Id 

< 

< H- 

rsj •/> 
z 

:/) < o 

< Z D < 
X Z D 

•jj o r /) 

H- X O U 



O O O o 



(VJ i-i O — < 



00 ^ ^ ^ 



4" o o ^ 



^ o ^ o 



rn — < o o 



< 

> a 

-I jj 

>• r 

:/) o 

< z z ^ 

-I z ^ < 
O UJ jJ <xJ 

3 a ^ .X 



X 2" X I 
CL 3 Ol 

46 



I 



O 

•f) 

uJ 

O 
3 



O ^ ^ 



OJ o o o 



o o ^ ^ 



o o 



UJ 



to 

Ul 

o 
< 



a: 
• u 

^ z 

H- Ul 

< < a 
uj r < 
zoo. 



o o 
z h» 



to ^ 

ul >0 



o >t 



to (\J 
Ul 



o ^ 

z tn 



UJ >t 



Z O 



to rO 
U( OJ 
>- OJ 



UJ 

-J 

a. 

UJ UJ 

o 
r *j) 
z 

UJ 

o 2: 
o 

Q O 

LiJ 3 



O If) 
Z <f 



to o 

UJ 00 



o o 
z n 



UJ 



o o 
z o 



to ro 
UJ <^ 



Q 

jJ o 

O ^ 

< ♦ 

-I > 

< -I 

O 3 



O OJ o h* J) ^ h» 

^ 0\ ^ CVJ ^ N» 

X <f m m ^ 

3 oo o OJ <f h» i\J 
o m h» h» OJ h» '/i 
X OJ ^ OJ OJ ^ 

h» 00 m (n>» 
^ t/) m ro n h» 

-J OJ ^ M 

UJ 4- ^ h» o in 

Z 'i> I/) ^ GO OJ 



o I/) o m I/) 
ro ro CO ^ \0 

X 

O o o n OJ OJ 
O ^ ^ ^ 30 vM 
X 

K- OJ >r) in >o >r) 
1-4 ^ ^ ro 



UJ OJ ^ O 3^ P*- 
Z CVJ ^ P*- 

o 



o in OJ nO in 
»-H J) m ^ in <^ 

3^ 

3 OJ in *j) 00 sO 
o •'^ OJ m OJ 

^- ^ 00 ro OJ J) 



z 
o 



tr ^ sO ^ o 



o >r) tn o ^ h» in 

o J) OJ in n 
X ro ro ^ CO 

3 o in OJ >t 
o tn o so rvj in OJ 
X ^ ^ ^ ^ ^ 

^ ^ ^ J) in j:> 
ro ro »n CVJ X nO 



UJ > 'n rvi ^ GO 

^ m ro i> ro in 



z 
o 



< 



Ui 

z a: 

uj O 
X H- 



H- »-H 'y) 
I- Z 
UJ 3 Z 
to X 

X s: 
_| o o 
< o < 
o 
o 



-I to 
UJ H- :/) 

Z CO Z H- 
Z a: UJ Z 
O Ul O uJ 

to r 3 3 
:r o 3 
UJ < \n 
Q- Ul un. 

H- -I 
3 O >- 

UJ X o a: 

O X ^ 
ti^ O O H- 

»-H a -o 

to to UJ 

to m X X 

< < ^ UJ 

-I >J ^ -I 

O O X Ul 



UJ 

< 



2 

a: 
o 
u. 



< 

o 

o 

UJ 
H- 
<t 
H- 

I K- 
I X 

o 

O (X 

a. 

u 

Z -I 

O (X 



K- t/» ^ 
< -H _J 

3: o < 

o -I 

tj- o 

z o 
-H r 

o 

./) 

to 

LU ^ 

o n 
o r 
cr 



UJ 



o 



EKLC 































-1 ^ ^ M 00 




O tO 00 00 


O o 








C 




o o 












0. ro in ^ ^ o 




2 M o 


2 C> -XJ 










2 -n 












X 4- n oj ru rvj 






' UI 
























CO 


-J 










n Ln .\j o 








• 'J^ ^ 00 ro 




< 






o x> ^ 


^ O 


>t ^ X X 






o 


^ ^ If) 












~ 










Z OJ ^ 












z 








o 






























H- 


t/^ ^ CO ro 
UJ o rvi in 


CO <t- 

UJ ro ^ 








CO TD 


CO 

UJ 00 












H» <f 00 in fo ^ o 
^ CM »^ r*» 


r-l 


>. 


>• ^ n 








> 




>- ^ 












Z ro CM 4- rvj ^ 


CO 






























00 



























































^ > o ^ in ro 




o O 


o 4D 








O 


«-< 














0. CM 00 in m ^ m 




2 f\J f\J ^ 


2 ru o 








2 r>J 


2 fVJ 














-J 
Ui 






























»— • 






O ro 


^ o 


in 00 =^ m 








• 


o o r*- 






ti. 












■ 


o 


rvj >T ^vj >T 










z 












2 












z 






























I> 


,n c> o o 


CO o 










in 














K- in in ro ro ro 


vO 


:iJ ^ 30 rX) 


UJ 00 








UJ 




Id CO 












< C7^ \0 »^ \0 'O 


>• 


>- 








>- 




>- ^ 












z ^ 


O 






























CVJ 


























































_J O CM O ^ O CO 




O O ^ O 


o o 








o 




o in 












X in ro rvi CM »^ 




^ »^ r-H »^ 


z n ^ 








z 




2 












3^ 


a: 




























o 


< 




























o 


Z 






• 30 O 




ru J) CM 








• 




^0 o o 


















■ 


o 






^ -\j 




o 






z 












2 












o 






























li 


n JO OJ 


CO -O \J 








CO 




-O 












h- ro »^ »^ ^ 


^y) 


UJ N. f*» TO 
>- 


.aJ XI 'n 
>- 








> 
















»^ ro CM *.n CM »^ 

z 


CVJ 
























































































J '7^ ^ m 3* 


>- 


O x> 


o ^ n 








o 




o ^ 












a. »^ o CO sO >^ 


or 


Z >^ X> \f\ 


2 ro rn 








2 


30 


2 












7C ro ''VJ ^ ^ ^ 


< 




























o 
































z 










sO r\j ^ 










TO 








UJ 






o rvj vD 


CO 


n CM >X) ^ 










in 


ro 




00 












— . 


o 






z 






2 












z 












UJ 






























—J 


to ^ in oj 


LO O o 








CO 
















h- in CT» o o o 


UJ 


UJ J) vD 30 


UJ C> 30 








jj in 


UJ f\J 












30 »^ ro ^ CO 30 




>- ^ 4- ^ 


V (\J ^ 
























Z (M (M ^ 


^ 1 






























CO 






























to 


































a. 




















































































>- z 




7 < 


























X X; 




O UI 


2: -I 
























0. CO o 






O jJ o 
























O ;^ O UI 




H- a. < 


^ O 












-1 












CO -O o o 




< y) 3 


J— ^ r 


•t 










*^ 












o 'jj X y^ o 






< CO o 












o 












to ^ > CL ^ :d 




Z> X <t 


X n 












o 










en 


^ 1^ '/) > X 




n ■:: 
















CJ 








x 


O X .L _J 




t-^ X ^ 


a. o X 


-1 










!jj CO 


2 








< 


uJ a. o o o o 




h- O O X 


O O H- 








<i 


'J) 


-1 :o 


UJ 










"> UJ O UJ 




X — » 0. 










o 


UJ 


O UJ 












O -1 ^ < X -I 'vj 




<r ^ <t 




< 






'D 


'J 


o 












C X) O O O — i 




a — • o n: 


2 CO 










o 


o o 


UJ 








u 


rL o o i-« CO o — 1 




:r 2r o 




UJ 








:i: 


Ld X 


'IK 








X 


X Q X < 




>- X O 


H- X < 


'S> <f 




T ^ a 


-1 


Q. 


X CL 








Q- o X 2 Q o or 




H- H- O I'j 




< 








O 








nr 




D CO < Ui CO H- 




^ UJ ^ 


•jJ < O 








X 


o o 


uJ - 


^ <t 


< 


<t 




1 N a CO \ 2 




z 


CO jJ 


2 1 1 


1 1 


1 1 1 1 




2 


H- 2 


^ uJ UJ jJ UJ rt 


* ^ '3 ^ h- UJ 




Z) ^ «l ^ 




uJ 






X 


•—4 




o : 






>- 




o O < > wO CJ 




:r -J -J -J 


-1 H- UJ 


O o lO o 


n o in o 




H» 


2 1- 


> 










-1 a: o UJ "-H UJ 




3! < < < 


<i < 






-• f\j ou in 




H- 


< H- 


(J '-^ rvj ro 




-1 Q a. CO a: Q 3 




O 


o 


UJ 






o 


UJ 


-1 IaJ 


UJ 










o 




u 


o 


X 




47 


2 


CO 


a. wO 


,x 










U. 



























to ^ ro CO 


o ^ o (\j in 


CO in 


in rn f*- 


m n o r** OJ 


CO n 


CVJ in 00 n 


OJ r*- in r*- ro 


UJ 




Ui ^ ^ JO nO o 


^ ro o f*) 


aJ in 


^ CO >o in 


^ o r*- ro r*- 


ui in 


^ o m 


in o f*- ^ 


o 




O CM 


)-« 


o 






o 


OJ 


CO 


< 








































< 








































o 






















t 1 ^^ «^ 


A.I vO A^l 

i\j \ij \\i r*! ^9 




^5 r*" 


fw 

1 1 






Z*^ #M 

lil O O CQ UU 






Ui >£) ^ m ^ oj 


CVJ >o >£) CO 


UJ o 


ro 00 ro 


OJ in ^ o ^ 


UJ 


r> 00 n ^ 


1^ O CO 




r-l 

CO 


a: ^ ^ ro 


<f n 












n 




ffS 
\AJ 






















CO 00 ^ ^ 00 


IT) o >o n 


CO o 


[f) Xi (M 


^ in 00 o ro 


C/) >£) 


^ f*- O J) 


OJ m o c^ in 


< 




UJ (\J ^ LO 


i/i »/> >t 


UJ OJ 


OJ ^ <f 






^ ^ 


C7^ r\j 


»<<H 




o 




o 






o 






z 


Ui 






































o 




















tl. 








































-1 




O O vO O CVJ LO 


p*» ro o ro 


o rvj 


^ O O OJ 


o >t n o 


O OJ 


in o p^ ^ 


^ n CO >£) ^ 


< 


vO 


UJ oj ^ ro oj p*- 


rsj o OJ •\J 


UJ n 


^ ^ ^ i/) 


^ >£) OJ <f 


UJ ^ 


OJ tn 




o 






q: 






a: 








O 




















CVJ 


















o 




















Ui 




































































































Ui 




CO LO ^ >£) ^ 


ro ro •/) 




ro CO ro 30 


o o ^ in >o 


CO ^ 


OJ 00 in 


o ^ o r*^ ^ 


1 K- 


>- 


Ui (M 


OJ ^J 


UJ 




OJ ^ 


uJ 




n 


• a 




o 




o 






Q 






o 


< 




















o 


















X jJ 


z 


















o oc 


o 


















Q. 


o 


















UJ J} 


UJ 


o o >o nj o ro 


o o lD N. 


C-) ro 


rvj ^ ^ ro 


>t OJ 




ro ro rg 


o 


0^ ^ 


/) 


UI ^ rg ro 




UJ 


^ ^ OJ 




UI ^ 


























2 


CvJ 


















o a ^ 


Ox 






































H- to -1 




















< »-i _| 




















Z Q < 




















or 




















o _| 




















o 




















2 O 


>- 


CO >£)>£) OJ LO ro 


ro o OJ 


CO 


^ o 


^ 00 X n ro 


CO n 


O o ro 


^ CO >o ^ 


i-i r 




Ui 'M LO ^ ro 


O vO lO ^ 


UI ro 


m o 


^ o OJ ro 


UJ n 


<f OJ in 


r) ^ in 


o 


< 


o 










o 






if) 


r— 


















CO 


2 


















Ui -« 


Ui 






































o c: 


UJ 




















-1 


U X) if) -X) O 


m -7^ o 


O OJ 


ro o rvj 


ro -4 ^ t\j ro 


o n sO ^ o 


o 00 GO CO 




Ui 


Ui ro ^ O 


^ ro ^ ^ 


UJ l/> 


OJ >£> LO >£> 


— • ro in ro in 


UJ ^ 


^ OJ oo 








OJ 


ro OJ 






OJ 


3r ^ 




•—I 


iD 


co- 




















co 




















m 














































































(/) 




















-1 








































O 






















































Ui 














J) 
















o 










2 










2 




2 






< 














•? 
















2 










CO 














-1 






i-H 










< 










CO 














7> 
















H» 




2 






< 














O 




h- 












UI 


-1 O UJ 


o 




J vj UJ 


-1 




-1 O UJ 






o i: 


^ >. I-I 




r 


<a >. i-i 


< 


X 


< 1-4 






3 o 


a: UJ a: < 


UJ ^ 


O CD 


lT UJ H- 3: < 




Q CD 


•X oJ < 






> O O i-fxl 


UJ 2 H- > 


o o 


O i-iUJ 


UJ K- 2 I— > 


o o 


O 1— i UJ 


Ui H- 2 H- > 








i-l -1 




2 -1 


r X o 


O < 3 CO 






UJ oc UJ ^ a ^ cc 


CO 




UJ O i-i (X 


< 




UJ o tr 






co^^Jn.ttn3u.cooocL 




2 OJ n ^ in 3 


U- O O 






2 O 












o 




FRir 




I-I to 




o 


48 ° 











UJ 
< 



< 
O 



CO 
00 



a: 
o 



< 

u 

u. 
o 

Ui 
< 

tO 3 
I K- 

1 a: 

o 

X ^ 

o 

UJ s/i 

2 ^ <> 

o o: ^ 

H- to -I 
< »-H _| 

S O < 

o ^ 
o 

2 O 
»-« X 

o 
/) J) 

UJ ^ 
O CO 

o a- 

q: 

Q. 

to 

2 



UJ 

in 



O 

o 



ERLC 



UJ 

3 n <f oj in vo 
-I ^ ^ o r** o 
< ^ ^ 
> 



o o nf> in n 
< tn o N- 
CO ^ ^ 



vO 
O 



3 n nj o rvj 
_j ^ ^ ^ f\j 
< ^ 
> 



sD vO ro n o 
< ^ ^ oj oj 
CO ^ 

3 



< 

o 

o 
o 

oJ 

CO 

CVJ 
ON 



< 

2: 

UJ 
Ui 



CO 
CO 



UJ 

3 ^ 



< 



in 



•jj 

o -O rsj o h» 
< 'n 

C/) 
3 



UJ 

3 lO ^ <X) O 

CO -I rg ^ N» n 
a < oj 

Uj > 

^ UJ 

2r o a* en in ^x: 

H-4 < OJ ^ 00 t >i- 

h- tO rvj 

Ui 
CO 



< 
O 

o 



O 
UJ 
Q. 

UJ 



O 



6 > 
c — 



= 1 
II 

• 

fm 3k V* 

c o o 

r: a o 
£ o o 



O 2 ~ *^ 
I O O »^ 
H- Q. _| X X 

u H» ^ ;vj ro ^ in 

3 CO 

o 



UJ 

3 ro ^ ^n o 

«J OJ OJ O O 00 

> 



UJ 

CO o vD in 

< (M OJ OO 00 OJ 

CO in 

3 



3 in GO o 00 o 

-I OJ OJ OJ 

< ^ 



•aJ 

< 

CO 

3 



>o h«- o 
OJ OJ ro 



o ^ h» o ^ 



< 



UJ 

o r*^ o 
< O 

n 

3 



uJ 

3 00 OJ h» h» 
^ ^ ^ ^- in 
< OJ 



rvj OJ 
< OJ ^ in in OJ 



CO 
3 



ro 



lis 

c o 

o S5 
c o a 

J3 S 2i 

0 ^ Wl 

01 a 3 
?^ 2 

£ S 



OJ 

o 

X -I 



o 

X 



OJ r) ^ fX> 

CO 



UJ 

3 OJ p-N O sO 

-I inin so o in 
> 



UJ 

CD N- 30 vO o 

< ^ ^ o o 
to ^ ^ ro 

3 



UJ 

3 n ro ^ o 
_i ^ ^ ro ro o> 
< 



o o n ^ OJ ^ 
< ^ ^ ro n o 

CO ^ 

3 



3 



< 



vO vt) o 'n 
^ 



UJ 

< 
J) 
3 



>3' vO ^ o m 
rvj ^ >^ 



3 ro ro o ro 
«j ro ro ^ OJ 
< ^ OJ 

> 



c> CO <r v£; 

< OJ OJ -7^ \0 



3 



OJ 



%2 



a o 

3 a 
« o 

si 

« T3 
O « 



5 

X 



X 
X 



o 

JL -I 

;^ 

h- ro .J- in 

" 49 



UJ 

3 O 

-I h» 
< 



00 ^ rsj >t 
n 00 in in 

OJ 



uJ 

CD 4" sO sO ro 
< h» vM 00 in 00 

CO OJ 
3 



< 

> 



UJ 



oo >o 

sD 



vD J) in h» 00 

cn 

3 



jJ 



'j> ^i- in >o o 



< 



vD N- o ro 
< ^ n 

-O 
3 



< 



33 X) 0> LO 

OJ vn OJ in 



O o O ^ C» OJ 

< in OJ in n 

CO 



E . 

2? 



O wi O 



A S q 



h5j 



-I X r 
OJ ^ in 

cn 



3 o ^ ro 00 
-I so OJ o in in 

< OJ 

> 



o 00 ro ^ 
< >o h» in t> 

CO OJ 
3 



3 OJ m o ro 
-I OJ ^ h» 
< 



vD h» OJ OJ h» o 

< ^ OJ 00 

CO 
3 



< 



CD 
< 

in 



o OJ CO 'n 



4* O 



^ X) vO LO 

^ —I sO n ^ 



< 



UJ 

O -r* 

< ^ in n h» 
co ^ 



E 
£ • 

T3 E 

2E 
? o 



Sri 

OI E 
£ « o 

550 

£ c « 
hS5 



in 



X 



^ c 

D 3 

0.-1 X X 

^ OJ ro j> 

LO 



0- 



00 



3 ^ t) ^ 

^ ro ^ ^ 00 lH 
< ^ ro 
> 



uJ 

O t> o o >o ro 

< ^ rvj Ji 

to p-< rn 



3 o n ^ o o 
_i -4 n c\j c^ 



< 




< 




o 


> 


2' 


UJ 




cc 






o 










UJ 






o 


-1 




< 


< 




1/) 




vO 






O 




u. 


CNJ 




o 






UJ 












<l 










UJ 


(/) o 






UJ 




-J 


1 K- 


> 


<r 


1 


a:: 


> 


o 


< 




a. 












o a: 


O 


UJ 


a. 


O 




UJ :/) 


UJ 


< 


a: i- 


•y> 








3 


rt\ 






o a: ^ 


ON 










K- _J 






< *^ -1 






^ o < 






or Ul 






O -1 




UJ 


o 




3 


2 C 


> 




— i X 


a: 


< 


o 


< 


> 


./) y> 






CO 


-Z 




UJ ^ 






O 




UJ 


O C 


UJ 




a 




< 


a 


UJ 


in 






3 




CO 




? 


cn 




—4 






K- 






K- 






Ul 












-1 












O 






o 







UJ 

3 ^ oj ^ ^• 

-I. I/) OJ CO sO o 

> 



CO OJ OJ 
< in ^j sO OJ 

3 



3 #H ^ 

< 
> 



\0 CO 
OJ OJ 30 



OJ ^ o 



^J 



o :ri ^ 



OJ 



ERLC 



o n ig 

5 

'•Ml 10 M 

S o « 

an 

s Er 
• * s 

o 2 o 
5 Eu • 

> O C A 
9 u la «« 



o 5 

Ol -J X 
UJ 

H- '-^ OJ n ^ in 



O OJ or GO 
^ ^ ^ ^ 

3 



3 rn o vo ir» >t 

-I st 

< 
> 



o >t ^ o 

3 



uJ 

3 ^ -< IT) -O 

-I n OJ in n 
< -< 
> 



uJ 

O r*^ Oj nr 

< n OJ m no 

CO 
3 



o o 



0. 



3 ^ 

31 X 



H- fv ro >t lA 
CO 



UJ 

3 O O >t O 

J OJ OJ ao OJ 



.0 OJ o ^ m 

< OJ ^ 

CO ^ 
3 



3 ao vO ro o 

_j ^ OJ ^ 

< ^ 
> 



O c> OJ .i- o ao 
< ^ OJ ^ 

CO ^ 
3 



3 o OJ o <r- J- 
_i ^ ^ 
< 
> 



;o ^ ^ o ^ 
< ^ ss 



3 T OO ^ ^ 

-I ^ ^ in 4- >o 

< OJ 

> 



J) rvj >t 

< OJ ^ lO >t 
CO OJ 
3 

a 

— w 

0 c 

•0 £ 
T3 

• T3 

q2 

O 

"° F 
xj t 
)3 ° 

Ic 
c « 

1 as 

(D ^ O 
£ P »rt 



UJ 

3 >t <f n in 
_i n ^ ^ o 
< n 



UJ 

CD <t vo o in n 
< CO ^ vO in 
CO n 

3 



3 O vO ^ 'J^ ^ 

«j ^ OJ ^ 

< 

> 



o vO in 00 in 

< #H ^ 00 

LO 
3 



uJ 

3 in o m c^ >o 

< 
> 



UJ 

o ^ o in >o o 
< 

CO 
3 



t) ^ ^ r 

3 O *i 

a. -I T r 

JLi 

H- -Nj r5 st in 



uJ 

3 00 7^ 00 

-I ^ ^ ro O 

< ^ 
> 



UJ 

O o o vO 1^ X» 
< OJ ^ >t >t o 

CO OJ 
3 



1 



o c 

J" 

M > 

2 c 

fii 

2 o 
~ o c 
o S ^ 

w C 

(0 -» 



r 

o ^ 

:Fr r 



o 

X -I 

UJ 

H- p-4 f\J x**^ .t 10 
CO 



3 ^ OJ ^ 30 

-I n OJ 00 nO >o 

< OJ 

> 



to OJ >t ^ >t nO 

< ^ OJ o> o 

in OJ 

3 



uJ 

3 o m OJ n 

_| ^ OJ ^ vO 

< 
> 



O o .i' OJ OJ 

CO 
3 



3 OJ > ^ ^ 

< 
> 



to ^ >t ^ 
< ^ n 

CO 
3 



uJ 

3 nO 30 OJ 00 

_i OJ ^ in >t ^ 
< ^ 
> 



UJ 

0 O tr 
< ^ vO >t ^ 

3 



u a w 

°si 

S = E 

s " S 

Ills 

oE^5 



o o 
X -I T r 

h- ^ (\, ro ^ 



50 



UJ 

o 

Q. 



< 

O 



CO 
00 



o 



< 



o 

Ui 
< 

(/) Q 

WLi 

I K- 

I cr 

o 

3: JJ 

o a: 
a. 

z -H 

o CC 

H- s/) -I 
< J 

□r ijL. 
o -J 
u. o 
z o 

r 

o 

, f 1 ^ 

o ro 

O re 

O 

■z 



UJ 



o 
o 



Q 
uJ 



vO 
O 



Q 
O 

o 

t/) 

CNJ 
ON 



< 



•D o 00 ^t o 
«j n o in 
< ^ 
> 



o o ^ 

< >t ro O Lf) o 

C/) OJ 



3 Oj ^ ^ X O 

_| ^ ^ CM 

< 

> 



'>o ;f a> ^ 
<c ^ ^ ^ ^ 

3 



3 C\J CM n 7^ ^ 



o >t o 



CO 
CO 



ERLC 



3 vO vO ^ ru 
-I AJ fM nO ro ro 
< ^ 



o o >t >t ^ >t 

< CM CM o ro 

J) ^ 
3 



* o 

© irt 

ECS 
c a w 

c 

« Ml M 

• ^ — 

Op ? 
Q c • 



« O "C 



^ ON ^ 00 
-I m >t o o r*- 
< n 



UJ 

O O vO >t o o 
< >t CM j> 
to ^ 
o 



3 rn 00 CM 

_j ^ M ^ O 

< -t 
> 



O ^ r*- o 

<t ^ ^ ^ f-i^ 

LO 
3 



3 O >t O v£) — • 

< 

> 



O ^ CM no CM 
3 



X 

c ^ 
o ^ 
:z x: 



K- ^ ^ in 

CO 



UJ 

3 o o in >t 
-I ro CM ^ 4- ro 
< fM 
> 



CS CM ^ jn fM 

< CM ^ C> 

'jO cm 

3 



o > 9 
-eg 

= I- 



w O • 
c ^ •* 

" c 5 

SI C ^ 

> • M 

EES 



3 o n 00 

-I CM (*j O 00 00 

< ^ ro 
> 



UJ 

;D 'M in 

< ro ro CO o o 
to ^ ^ 

3 



3 O <X> fM 0> 
_| ^ CM CM ^> 



uJ 

o ru in o> CO -n 

< ^ ^ CM O 
3 



3 i-*) rvi 

-I >t 

< 

> 



UJ 

o >t '-^ o 00 

to 
3 



fM 



O O 

a. -J r r 

h- rvj ro >t tO 
to 



UJ 

3 O ^ X >t CM 

-I CM Ln ^ 

< CM 



C >o C >t 

< ^ oj so vD in 

to CM 
3 

t at 

iO M 

■=50 

^ « 

> o 

III 

u « ^ 

'l|2 
(/) o « a 



ro X 

O 

a «j X 

uJ 

h- ^ CM fn ^ LO 

51 



3 ^ O CM >t 

-I CM >o r> 30 

< ^ 
> 



o ^ >t in in 

< r*- fM in ro o> 

to ^ 

3 



3 ro in CM >t 
_i ^ ^ 



uJ 

O 00 to in 
< u*> 

LO 
3 



3 m CM 0 m 
-I fM 
< 



O CM ro 
< rvj 

3 



3 <X) X ^ 

_i ro ^ r*- ^ r*- 

< CM 

> 



o fM o X n o 

< ^ ru o in X 

sTi CM 

3 



3 in ro o 
< 



o m >t fM n 
< ^ ^ 00 
to 
3 



3 ro ^ o 'O ro 
-I n 
< 
> 



O <t o r*- o m 

J) 

3 



3 ro ro OJ ro 

_| >t F-* CM O 

< ^ 

> 



(S> X U \i rn 
< >t — • fM ^ 

to ^ 
3 

s 



oE 

si 
> « 



Si 

c « 



<t X 

o 6 
rx -I :z X 

UJ 

h- p-« CM ro >t to 

LO 



UJ 

3 X CM >t C> 00 
-I CM ^ LO M LO 
< ^ 
> 



o ^ X ^- -n >t 
< ro ^ vO 
to ^ 
3 

> . E 

£ w» 2 ^ 

c oz 
• 00 *^ ° 
p ft 

c °> c 

- T > 
c ^ o -c 2 

« fei:= 
uJiE^f 



J) X 
2" »^ 

O O 

Q. -I :^ X 

UJ 

H» ^ (M n >t in 

LO 



UJ 



CO ^ 
<X _| 

3: o it 

o -J 

2 o 
—I r 

y) J) 
to 

UJ ^ 

C T 

a: 
Q. 

o 



UJ 

en 



o 
o 



ERLC, 



si 



CO'' 

cOi.i 



3 n 
^ <f OJ 
< 
> 



^ ir> o 
oo o o 



o m 
0) M 
4- 



UJ 









>o OJ o 








OJ 






< 






o 


> 






-ij 






■v 










u. 


















O 00 


c> h» oj 


—J 


ZD 


< 


^ ^ OJ 












VO 








O 






lu 


CVJ 






O 


1 






LU 


! 






< 


j 














(/) O 


i 


3 ^ O CO CO 










1 H- 




< 




• X 




> 




o 


















i' 






o o: 


O 


UJ 




a. 


a 




r\j 7^ oj 


oJ n 




< 




















Z 








o a: ^ 









UJ 

3 o h» LO n o 
•J ro ^ *o m ^ 



UJ 

< <i- 

to 

3 



>o o 00 h» 
-4 O ro LO 
(\J 



UJ 

3 ^ LO 

<x 
> 



vO nX) 00 



n c^ 
< ^ ^ \0 
J) 



rg ^ ^ oj n 



UJ 

UJ 

-J 

ml 

CO 
IT) 



ID ro OJ "VJ ro ro 
-I ro oj Ln 
< OJ 
> 



cr 4f OJ '> 
< ro ^ LO iX> 



CO 

3 



OJ 



J2 



" E 



□V wi 

r: o 
I- > 



CO 



i\j fn >t iS'i 



< 

> 



•4J 

O st 
< 

3 



o r*- si- 



3 ^ ^ ro m CO 

-I OJ st OJ st 

< ^ 

> 



n OJ o o ,t 
< OJ ^ 4f n CO 



ii 

o 

3 O 

b o 

o £ 
o 

JL o 
o 

o jr 
52 

•"T3 
10 c 



oo 00 n 4- 4- 

*o CO ^ 



CD ^ O OJ st --^ 
< OJ 4- O 

CO 
3 



UJ 

ID h» ^ ^ ^ ^ 
-I ^ >t 

< 

> 



uJ 
< 
3 



O O 00 



3 ^ -« 



> 



ro 



o ^ o ro tr> OJ 

3 



H- ^ OJ o st in 



3 o >o ro st OJ 

_i ^ ^ ^ ro ro 

< ro 
> 



>t O 0^ OC 

< ^ ^ OJ ro X) 



■J) 

3 



ro 



i5 



If 
P 

E n . 
o o S 



o 

f5§ 



o 
5: 



3 n ^ CO o h» 
«i en n 00 o 
< n 



;i> n CO 00 

< in OJ h» ro 

CO ro 

3 



u; 

3 O J> ^ '>J O 

< 
> 



'vD 00 00 CO si- o 

< ^ ^ o 

CO ^ 
3 



3 h» h» 

^ OJ ^ O sO CO 

< ^-4 st 
> 



UJ 

o h» 00 m 00 

< ^ ^ 00 nO rvj 

CO cn 

3 



3 in 
-I 
< 
> 



st st 

OJ :\j 



3 OJ 



> 



o OJ ro 
^ ^ ro 



c> ^ o 



ro 



< 
CO 
3 



00 >o n 

OJ ^ OJ 



3 OJ OJ LTJ 

-I 
< 
> 



o o 
^ CO 



UJ 

vD OJ ^ O) :o 00 
< J> 

CO 
3 



3 ^ O st st 

— I ro OJ tn r) 00 
< ^ 



aJ 

OJ si- o ro ^ 
< si- -4 tn si- o 



'J) 
3 



OJ 



UJ 

-« OJ n >r 

'wO 



52 



SI 

= 1 

C _ 

> ci u 

o 

o** o 
How 



O O 

a ^ s r 

UJ 

H- ^ oj ro ^ i/) 

C/) 



^ U k. 



3 si- (> OJ ^ r-* 

_j ^ h» si- o 

< ro 
> 



UJ 

^ si- si- ro 
< ^ CO si- 4- 



in 

3 



ro 



t; « 

-o o 

iS 

a? . 
2- a 

c > . 
^ r* M 

I- a o 



O 

3 

a. -I 



o 



H- ^ M ro ^ u-* 

CO 



